Connecting...

Blog Img

Python Live | Statistical Types for Pandas DataFrames and Friends

Back to Blogs

Statistical Types for Pandas DataFrames and Friends: Parse, Validate, and Synthesize DataFrames with Generative Schemas

This webinar comes from Machine Learning Engineer Niels Bantilan. As well as working as an ML Engineer at Union.ai, Niels is also creator of UnionML, creator of Pandera, open Source Maintainer of Flyte.

Synopsis

DataFrames are one of the key data structures that data practitioners use to manipulate tabular data. The pandas library, for example, is flexible and powerful, but working with DataFrames for complex use cases often leads to unexpected data types, invalid values, and overall opacity in the contents of a particular DataFrame as it’s transformed from its raw form to one that’s ready for analysis.

In this workshop, you will learn how to ensure data quality with Pandera, a statistical data testing tool for pandas-like DataFrames, so that you can be more confident in the correctness of your code.

Covering:

• Why should I validate data?

• What’s data testing, and how can I put it into practice?

• Pandera quickstart: create statistical types for your DataFrames

• Example 1: Validate your Data analysis

• Example 2: Validate your Machine Learning Pipeline

• Conclusion: How can I start using Pandera in my work?

The Python Community

Python Live is a series of free, live events designed to connect the tech community and educate Python, AI and Machine Learning professionals worldwide for free. By bringing successful people together, we can add value to tech professionals who want to develop their skillset as well as for tech leaders who want to help their team to develop.

The Live Series Webinars

The Live Series webinars are Python Live, JavaScript Live & Golang Live. Find out about the latest webinars via Amicus LinkedIn and The Live Series LinkedIn pages and access the full backlog via our YouTube Channel.

How Can I Attend Webinars?

Simply check out all our upcoming events via our Eventbrite page. Head there now to register as spaces can fill up quickly!

Find Python Developers

Source the best Python developers from all over the globe. Our database is full of top-tier Machine Learning Engineers, Golang Engineers and JavaScript Engineers. Have a Python Developer join your company on a contract or permanent basis. We'll give you all the support, advice and resources to make sure your company find the perfect fit to fill your vacancy.

Yt Thumbnail Roundtable

Roundtable | Maintaining morale & keeping Engineers motivated

Copy Of Live Series Podcast Episode (1000 X 1000 Px) (1)

Episode 50 | Managing Your Tech Team Effectively

Untitled (1000 X 1000 Px)

Episode 49 | Building Empathy & Trust Within Your Team

Untitled (1000 X 1000 Px)

Roundtable | Performance Management Culture Within Software Engineering

Website Blog (38)

5 LGBTQ+ Names in Tech You should Know

Copy Of Live Series Podcast Episode (1000 X 1000 Px) (1)
Copy Of Live Series Podcast Episode (1000 X 1000 Px) (1)
Copy Of Live Series Podcast Episode (1000 X 1000 Px) (1)

Episode 48 | Hiring a Diverse Team Without Overthinking It

9 (1)

Diversity in Tech: Where Are We Now? An LGBT History Month Feature

9

​Tips For Managing Introverts on Your Tech Team

Copy Of Live Series Podcast Episode (1000 X 1000 Px) (1)

Episode 45 | Psychological Safety in Tech Teams & How to Implement it